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I.  Introduction 


1.  The  nature  of  game  theory.  Game  theory  is  a collection  of  mathematical 
models  formulated  to  study  decision  making  in  situations  involving  conflict 
and  cooperation.  It  recognizes  that  conflict  arises  naturally  when  various 
participants  have  different  preferences , and  that  such  problems  can  be  studied 
quantitatively.  Game  theory  attempts  to  abstract  out  those  ingredients  which 
are  common  and  essential  to  many  different  competitive  situations  and  to  study 
them  by  means  of  the  scientific  approach.  It  is  concerned  with  finding  optimal 
solutions,  stable  outcomes,  or  equitable  allocations  when  various  decision 
makers  have  conflicting  objectives  in  mind.  These  models  describe  how  one 
should  proceed  in  order  to  arrive  at  the  best  possible  outcome  in  light  of 
the  options  open  to  one's  opponents.  Game  theory  thus  attempts  to  provide  a 
normative  guide  to  rational  behavior  when  acting  in  a group  whose  members 
aim  for  different  goals.  In  general  a game  consists  of  players  who  must 
choose  from  a list  of  alternatives  which  will  in  turn  bring  about  certain 
outcomes  over  which  the  participants  may  have  different  preferences.  Chance 
and  random  events  may  also  influence  the  final  payoffs. 


2.  Related  subjects.  Game  theory  is  concerned  with  two  or  more  partici- 
pants involved  in  strategic  encounters  (games  of  skill).  It  thus  extends 
beyond  the  classical  theories  of  probability  (games  of  chance)  and  decision 
theory  (games  against  nature)  which  are  frequently  sufficient  to  solve  situa- 


tions involving  merely  one  player  and  random  elements.  It  is  usually  considered 

a distinct  subject  from  gaming  or  simulation,  even  though  interaction  between  3 jJction  ^ 

Ssclion  n ! 

these  subjects  often  proves  beneficial.  Game  theory  also  gains  insights  from  j 


conducting  game  theoretical  types  of  experiments.  And  since  such  encounters 


are  laden  with  various  concepts  of  value  and  worth , game  theory  makes  frequent  j 
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use  of  utility  theory  which  in  its  modern  form  was  originally  developed  as  a 
supplement  to  the  game  models. 

3.  Types  of  games.  It  is  obvious  that  the  full  scope  of  game  theory  is 
extremely  broad  and  most  ambitious,  and  that  one  must  restrict  himself  to 
special  cases  if  he  is  to  obtain  usable  results.  There  are  consequently  many 
logical  classifications  of  competitive  situations.  Some  that  have  proved 
helpful  are:  the  number  of  participants,  the  number  of  moves  or  choices, 
the  constant-sum  and  general-sum  cases,  the  cooperative  and  noncooperative 
situations,  the  various  states  of  information  available  to  the  players,  the 
different  restrictions  which  may  be  placed  on  side  payments,  single  play  games 
or  multi-stage  games  in  which  similar  games  are  played  repeatedly,  as  well  as 
more  dynamical  situations  in  which  choices  are  made  continuously  in  time. 


4.  Forms  of  a game.  In  1944,  John  von  Neumann  and  Oskar  Morgenstern 
described  three  abstract  models  or  forms  for  studying  games:  extensive  form, 
normal  form,  and  characteristic  function  form.  Most  of  the  models  used  in 
the  mathematical  theory  of  games  are  of  one  of  these  basic  types , or  a rather 
direct  variation,  extension  or  generalization  of  them.  A brief  technical 
description  of  each  form  will  be  presented  first , and  then  each  type  will  be 
described  in  more  detail,  along  with  illustrations  and  applications. 

An  n-person  game  in  extensive  form  can  be  described  by  a "rooted  tree," 
that  is,  a connected  graph  in  the  plane  with  no  loops  and  with  a distinguished 
vertex  or  node.  The  distinguished  or  initial  vertex  (root)  and  each  additional 
interior  vertex  (point,  node,  locus)  corresponds  either  to  one  of  the  n 
players  or  to  the  "chance  player."  The  arcs  (edges,  lines)  ascending  from  a 
vertex  correspond  to  the  alternate  choices  this  player  can  make  if  a play  of  a 
game  leads  to  this  point.  To  each  terminal  vertex  there  is  associated  an 


3 


n-dimensional  vector  in  which  the  components  represent  the  payoffs  to  the 
respective  players.  For  each  node  belonging  to  the  chance  player  there  is  a 
probability  distribution  over  the  ascending  arcs.  The  state  of  a player's 
information  at  any  stage  can  be  described  by  certain  types  of  subsets  of  the 
set  of  all  his  vertices  which  are  called  information  sets.  The  extensive 
form  usually  gives  the  most  complete  description  of  a game  and  is  used  to 
model  many  game  like  situations.  However,  it  has  not  yet  proved  to  be  the 
most  suitable  form  for  handling  the  computational  problems  involved  in  actually 
solving  games,  except  for  very  simple  cases. 

An  n-person  game  in  normal  form  is  characterized  by  n sets  of  integers 
^l’^2’"',Nn  Players’  strategy  spaces)  and  a payoff  function  F from  the 

cartesian  product  x ^ * ...  x Nn  into  n-dimensional  euclidean  space. 

The  vector  F(i, ,i„, . . . ,i  ) describes  the  respective  payoffs  to  th^  n players 
when  they  each  make  the  single  choices  i^.ig,. • • »in*  One  can  also  incorporate 
chance  into  the  game  by  including  a set  of  chance  moves  and  a probability 

distribution  over  such  moves.  One  then  works  with  expected  payoffs  in  the 
obvious  way.  The  subject  of  two-person  "zero-sum'’  games  in  normal  form  (the 
matrix  games)  is  well  known,  and  it  has  had  significant  application  to  many 
fields.  The  n-person  games  can  also  be  viewed  as  an  n-dimensional  matrix  in 
which  the  "rows"  in  some  one  dimension  correspond  to  a particular  player’s 
choices.  The  components  of  the  matrix  are  n-dimensional  payoff  vectors.  Games 
in  normal  form  are  used  to  study  two-person  games  and  n-person  "noncooperative" 
games.  In  the  latter  case,  the  theory  of  "equilibrium  points"  is  the  main 
solution  concept. 

An  n-person  game  in  characteristic  function  form  is  determined  by  a real 

N 

valued  characteristic  function  v defined  on  the  set  2 of  all  subsets  of 
a finite  set  N.  That  is,  v assigns  the  real  number  v(S)  to  each  subset  S 
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of  N.  N is  the  set  of  n players  denoted  by  l,2,...,n,  and  v(S)  repre- 
sents the  value  (wealth,  power)  which  the  coalition  S can  achieve  when  its 
players  cooperate.  Most  models  for  n-person  "cooperative"  games  are  analyzed 
in  this  form  or  in  some  variation  of  it. 

A game  in  extensive  form  can  be  reduced  to  a game  in  normal  form  by  using 
the  game  tree  to  introduce  a set  of  "pure  strategies"  for  each  player.  Each 
pure  strategy  is  a choice  by  the  given  player  of  how  he  will  play  through  the 
entire  game  tree  in  the  event  of  all  possible  choices  by  the  other  players . 

One  then  considers  "mixed  strategies"  which  are  probability  distributions  over 
the  set  of  pure  strategies.  In  the  case  of  the  two-person  zero-sum  games, 
determining  "optimal"  mixed  strategies  is  mathematically  much  simpler  in  this 
normal  form.  The  optimal  mixed  strategies  in  the  reduced  game  (in  normal  form) 
can  be  interpreted  in  the  original  extensive  form  of  the  game.  As  for  deter- 
mining optimal  strategies,  the  game  in  normal  form  maintains  many  of  the 
essential  strategic  features  of  the  original  game  in  extensive  form.  Historically, 
there  has  been  little  work  done  on  deriving  solution  techniques  directly  for 
games  in  extensive  form. 

A game  in  normal  form  can  be  further  reduced  to  a game  in  characteristic 
function  form.  If  the  game  is  "constant-sum,"  then  v(S)  is  the  "value"  of 
the  coalition  S in  the  resulting  two-person  constant-sum  game  between  S 
and  its  complement  N-S.  If  the  game  is  not  constant-sum  then  v(S)  may  be 
taken  as  the  "maximin  value"  of  S in  the  resulting  two-person  noncooperative 
general-sum  game  between  S and  N-S,  or  it  may  be  determined  in  some  other 
manner.  In  the  former  cases  the  determination  of  v(S)  is  rather  conservative, 
because  it  assumes  N-S  will  cooperate  whenever  S does.  Furthermore,  this 
reduction  removes  many  of  the  detailed  features  of  the  original  game : the 
nature  and  the  timing  of  the  moves,  the  nature  of  the  information,  and  the 
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specific  payoffs.  One  can  make  several  objections  to  it,  especially  in  the 
nonconstant-sum  case , and  any  results  determined  for  the  game  in  characteristic 
function  form  may  have  very  limited  use  when  interpreted  in  the  normal  or 
extensive  form.  However,  the  characteristic  function  seems  most  appropriate 
for  studying  coalition  formation  which  is  an  essential  feature  in  the  cooperative 
games.  From  another  point  of  view,  one  can  begin  by  assuming  that  he  has  a 
game  in  characteristic  function  form  independent  of  the  other  forms.  The  value 
v(S)  can  be  given  or  derived  somehow  as  the  inherent  wealth  or  power  of  the 
coalition  S when  its  members  cooperate. 

5.  Historical  highlights.  Although  some  game  theory  concepts  have  arisen 
over  the  past  couple  of  centuries,  modern  game  theory  dates  from  1944  with 
the  publication  of  the  monumental  work  Theory  of  Games  and  Economic  Behavior 
[25]  by  von  Neumann  and  Morgenstern.  Some  particular  two-person  zero-sum 
matrix  games  were  analyzed  in  the  early  part  of  the  20th  century,  and  the 
major  theoretical  result  for  these  games  (the  famous  Hinimax  Theorem)  was 
proved  by  von  Neumann  in  1928.  (See  English  translation  in  [24  (1959)].) 
Although  a principle  theorem  was  given  by  Zermelo  in  1913  [29],  the  first 
complete  definition  of  a game  in  extensive  form  also  appeared  in  Theory  of 
Games  and  Economic  Behavior.  However,  a slightly  different  definition  due  to 
Kuhn  [24  (1953)]  is  the  one  most  frequently  used  today.  The  first  game 
theoretic  model  for  n-person  cooperative  games  was  also  presented  by  von  Neumann 
and  Morgenstern  in  1944  when  they  presented  a theory  of  solutions  (stable  sets) 
based  on  the  characteristic  function  formulation.  Several  other  solution 
concepts  have  since  been  defined  for  the  cooperative  theory.  In  1950  Nash  [14] 
generalized  the  "saddle  point"  point  concept  and  the  minimax  theorem  for 
matrix  games  to  the  existence  of  equilibrium  points  for  n-person  general-sum 


noncooperative  games  in  normal  form. 


<wv> ...  - mmm  i ■■■«>» 


An  excellent  survey  of  modern  game  theory  until  1957  i3  presented  in  the 

book  by  Luce  and  Raiffa  [11],  Many  books  contain  an  exposition  on  the  matrix 

games.  A current  introduction  to  several  major  models  in  the  n-person  theory 

appear  in  Chapters  8,  9 and  10  in  the  text  by  Owen  [16],  L.  S.  Shapley  and 

M.  Shubik  have  been  preparing  an  extensive  work  on  the  multi-person  games  and 

their  applications,  and  some  chapters  already  appear  as  RAND  Corporation  reports 

[21].  Elementary  expositions  of  the  n-person  theory  have  been  published  recently 

by  Davis  [4]  and  Rapoport  [18].  A detailed  bibliography  on  game  theory  until 

1959  was  compiled  by  D.  M.  and  G.  L.  Thompson  in  [24  (1959)].  The  best  volume 

of  references  and  short  abstracts  of  game  theory  literature  to  1968  appears 

currently  only  in  Russian  [26].  Several  of  the  major  mathematical  papers  in 

the  field  have  appeared  in  the  five  issues  of  the  Annals  of  Mathematics  Studies 

- 

[24].  The  introductions  to  these  studies  also  provide  excellent  survey  material 
on  the  subject.  A new  set  of  volumes  on  game  theory  has  recently  begun  [28], 

There  is  now  an  International  Journal  of  Game  Theory  and  articles  on  this 
subject  appear  in  the  new  journal  Mathematics  of  Operations  Research.  A popular 
book  On  The  Game  of  Business  by  McDonald  [12]  views  several  real  cases  from 
the  world  of  business  from  a game  theoretic  point  of  view. 

I 

i 1 
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II.  The  Normal  Form 

!•  Introduct ion . The  simplest  game  theoretical  model  is  the  theory  of 
games  in  normal  form,  also  referred  to  as  the  strategic  form  or  as  the  matrix 
(or  polymatrix)  games.  This  is  simply  a list  of  pure  strategies  for  each  one 
of  the  players  along  with  a description  of  the  resulting  payoffs  to  the  players 
for  any  possible  choice  of  strategies  by  these  participants.  For  the  special 
situation  of  only  two  players  and  when  one's  loss  corresponds  to  the  other's 
gain,  such  games  can  be  described  by  a real  valued  matrix.  This  simplest 
case  will  be  described  in  some  detail.  Extensions  to  general-sum  games  and 
those  with  more  than  two  players  will  be  mentioned  later  in  less  detail. 


ix  games.  A two-person  zero-sum  finite  matrix  game  with  real 


pay 


acterized  by  an  m by  n matrix  A with  real  components  a^ ^ . 


Eac.  -iiioer  (or  row)  i in  = {l,2,...,m}  corresponds  to  a pure  strategy 
for  player  I,  the  row  player.  Each  number  (or  column)  j in  = {l,2,...,n} 

corresponds  to  a pure  strategy  for  player  II,  the  column  player.  So  I has 


m pure  strategies  or  choices,  and  I has  n pure  strategies.  The  number  a^ 


is  the  payoff  from  player  II  to  player  I if  I plays  his  i**1  strategy  and 


*th 


II  plays  his  j strategy.  If  a^  < 0 then  consider  the  payoff  to  be  la^j 


from  I to  II.  A play  of  the  game  consists  of  I choosing  a row  and  II 
choosing  a column,  both  in  ignorance  of  the  other's  choice. 


.th 


If  player  I were  to  pick  the  i row,  then  the  worst  that  could  happen  to 


him  is  that  he  would  obtain  min  a...  A conservative  player  I might  play  a 


l<j<n 


row  that  corresponds  to  a maximum  of  these  row  minima.  This  is  called  a 
maximin  strategy  for  I,  and  playing  this  strategy  guarantees  that  he  will 
obtain  at  least  the  lower  value  of  the  game: 


l<i<m  l<_j<n  J 

Similarly  define  a minimax  strategy  for  player  II  to  be  a column  which 
corresponds  to  a minimum  of  the  column  maxima.  Playing  such  a strategy  can 
assure  II  of  losing  no  more  than  the  upper  value  of  the  game: 


v__  = min  max  a.., 
11  l<j<n  l<i<m  13 


These  concepts  can  be  illustrated  by  the  following  array 


I's  strategies 


II’ s strategies 


1 

2 

j 

n 

all 

a12 

alj 

aln 

a21 

a22 

a2j 

a2n 

ail 

ai2 

a 

ID 

a. 

in 

3ml 

am2  •** 

3 • • • • 
m3 

amn 

row 

minima 


column 

maxima 


max  a.,  max  a.„  ...  max  a..  ...  max  a. 

ll  i2  i]  in  v. 


It  is  easy  to  prove  that  <_  Vjj,  that  is,  maxiinin  <_  minimax.  As  a result 
of  this  we  can  consider  two  cases:  one  when  v^.  = and  the  other  when 

VI  < VII* 

CASE  1.  The  Saddle  Point  Case.  If  Vj  = vJ];  = v,  then  player  I can 
assure  himself  of  obtaining  at  least  the  amount  v from  II  by  playing  a 


maximin  strategy,  and  II  can  hold  his  losses  down  to  at  most  v by  playing 
a mj-nircax  strategy.  Thus  v is  called  the  value  of  the  game,  and  a maximin 
strategy  i^  and  a minimax  strategy  are  called  optimal  strategies  for 

I and  II  respectively.  The  number  v and  an  optimal  strategy  for  each  of 
the  players  is  called  a solution  of  the  game.  The  game  is  said  to  have  a 
saddle  point  at  with  value  a.  . = v.  In  this  case,  prior  knowledge 

of  the  opponents  strategy  choice  is  of  no  value  to  the  opponent. 

One  can  show  that  if  player  I has  two  optimal  strategies  i^  and  i^, 
and  player  II  has  two  optimal  strategies  and  j2,  then 

• “ cl  • • • 

131  1]2  12^1  12D2 

CASE  2.  The  Mixed  Strategy  Case.  Although  the  most  that  I can  be  sure 

of  winning  is  v^,  it  seems  that  he  could  "expect"  in  addition  some  of  the 

gap  v^  - Vj  > 0 if  he  were  to  bring  in  probability  considerations  and  use 

expected  values.  A mixed  strategy  for  player  I is  a probability  distribution 

over  his  pure  strategy  set,  and  it  can  be  described  by  a probability  vector 

x = (x, ,x_,...,x  ) where  x,  + x„  + . . . + x =1  and  each  x.  > 0.  To  play 
l r m l r m l — 

a mixed  strategy  means  to  use  a random  device  to  pick  which  pure  strategy  will 
be  played,  the  i**1  pure  strategy  to  be  chosen  with  probability  x^.  Similarly, 
a mixed  strategy  for  player  II  is  a probability  vector  y = (y.^  »y2  > • • • »Yn) 
where  y^  + + . . . + yn  = 1 and  each  yj  >_  0.  Note  that  a pure  strategy 

can  be  considered  as  a special  case  of  a mixed  strategy,  and  each  player  has 


If  player  I were  to  play  the  mixed  strategy  x and  player  II  plays 
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which  is  the  inner  (dot,  scalar)  product  of  x and  the  j column  of  matrix 
A which  is  donated  A ^ . Likewise,  if  II  plays  the  mixed  strategy  y and 
I plays  the  pure  strategy  i,  then  I expects  to  obtain 


(2)  E(i,y)  = auyi  + a.2y2  + ...  + = A y 

which  is  the  inner  product  of  the  i**1  row  of  A and  y.  A^  is  the  i row 

of  A and  y is  the  transpose  of  the  vector  (matrix)  y.  If  I and  II 
play  the  mixed  strategies  x and  y respectively,  then  the  expected  win  to 
I (or  loss  to  II)  is 


E(x,y)  = I j x a y . = xAy. 
1=1  i=l  1 1]  3 


The  problem  for  player  I is  to  find  a probability  vector  x which 
maximizes  the  smallest  component  in  the  vector  xA,  i.e.,  that  maximizes  the 
minimum  of  the  numbers  of  the  form  (1)  as  j varies  from  1 to  n.  Let  e^ 
be  the  t-dimensional  row  vector  with  all  t components  equal  to  1.  Then 
I's  goal  is  to  find  the  vector  x that  maximizes  the  number  v subject  to 
the  constraints 


xA  > ve 
— n 

T _ . 
xe  =1 
m 

x > 0. 


(max  v) 


Similarly  II' s goal  is  to  find  a vector  y that  minimizes  the  number  V 
subject  to 
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AyT  < VeT  (min  V) 

— m 

(4)  e yT  = 1 

nJ 

y > 0. 

Note  that  v = ve  y^  < xAy^  < xVe^  = xe^V  = V. 

The  two  optimization  problems  in  (3)  and  (4)  are  a special  case  of  a pair 

of  dual  linear  programs  in  the  theory  of  linear  programming.  So  a game  can  be 
solved  by  solving  a pair  of  dual  linear  programming  problems.  The  Minimax 
Theorem,  cr  Fundamental  Theorem  of  two-person  zero-sum  matrix  games,  by 
von  Neumann  (1928)  (or  equivalently,  the  Duality  Theorem  in  linear  programming) 
states  that  there  exists  mixed  strategies  and  yQ  for  I and  II, 

respectively,  which  solve  the  problems  in  (3)  and  (4),  and  that  v = V.  In 

other  words  there  exists  probability  vectors  xQ  and  y^  and  a number  v 

such  that 

xrtA  > ve 
0 — n 

. T „ T 
Ayrt  < ve  . 

J 0 — ■ m 

The  triple  ^*0*^0*^  callec*  a s°i-utton  of  the  game,  xQ  and  y^  are 
said  to  be  optimal  strategies,  and  v is  the  value  of  the  game. 

3.  Examples . (i)  Consider  the  following  matrix  game. 

-110  1 
4 2 8 2 

4 0 13 

2 15  2 


One  can  compute  the  row  minima,  column  maxima,  lower  and  upper  values  as  follows: 
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Since  v^  = = 2 = a ^ = v,  this  game  has  a saddle  point  at  (2,2)  and  a 

value  of  2. 

(ii)  Two  athletes  tie  for  the  championship  and  are  awarded  with  a single 
trophy  worth  $6000.  They  agree  to  make  sealed  bids  in  multiples  of  $1000 
with  the  trophy  going  to  the  higher  bidder  and  with  the  winner's  bid  bcdng 
paid  to  the  lower  bidder.  In  case  of  a tie  they  will  flip  a coin  for  the 
trophy.  If  we  use  the  expected  value  in  the  case  of  a tie,  the  game  matrix 
in  thousand  of  dollars  is  as  follows: 


0 1 2 3 4 5 6 
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(ili)  A brewery  worker  can  buy  his  beer  before  he  leaves  for  his  summer 
vacation  through  the  brewery  at  a discount  rate  of  $3  per  case,  whereas  it 
costs  $5  per  case  at  the  resort.  He  ha3  no  idea  whether  there  will  be  cool 
or  warm  weather.  If  it  is  cool  he  will  drink  10  cases  during  his  vacation, 
and  if  it  is  warm  he  will  drink  15  cases.  Any  left  over  is  wasted  since  he 
drinks  only  at  the  brewery  when  not  on  vacation  and  there  the  beer  is  free. 
This  game  "against  nature"  has  the  following  matrix. 


Cool 

Warm 

Buy  10  cases 

' -$30 

-$55 

Buy  15  cases 

_ -$45 

-$45 

] 


There  is  a saddle  point  at  (Buy  15  cases.  Warm)  and  the  value  is  -$45. 

(iv)  In  the  matching  pennies  each  player  can  pick  heads  H or  tails  T. 
Assume  player  I wins  if  the  coins  match  and  II  wins  otherwise.  The  game 
matrix  is 


H 

T 


T 

-1 

1 


1 


This  game  has  no  saddle  point;  v_  = -1  and  v^  = 1.  If  I uses  the  mixed 
strategy  x = (1/2,  1/2)  he  will  expect  E(x,j)  = 0 against  either  strategy 
j by  II.  Player  II  should  use  the  same  strategy.  It  is  easy  to  check  that 
these  strategies  are  optimal  and  that  the  value  of  the  r,ame  is  0.  A player 
can  effect  this  mixed  strategy  by  flipping  his  coin,  but  he  must  not  let  the 
other  know  his  choice  in  advance. 

(v)  The  well-known  children’s  game  of  scissors,  paper,  stone  has  the 


matrix 


St  L 1 


The  optimal  strategies  are  (1/3,  1/3,  1/3)  and  the  value  is  0. 


4.  Solving  matrix  games.  There  are  several  methods  for  solving  matrix 
games.  A survey  of  some  of  these  methods  is  given  in  Appendix  6 of  Luce  and 
Raiffa  [11].  It  was  shown  above  that  the  problem  of  solving  a game  can  be 
reduced  to  solving  a pair  of  dual  linear  programs.  This  section  illustrates 
how  the  "primal  simplex  method"  for  linear  programming  can  be  used  to  solve 
matrix  games.  There  will  be  no  detailed  discussion  of  the  simplex  method  in 
general,  but  only  an  illustration  of  how  it  works  on  a couple  of  specific 
examples.  Those  unfamiliar  with  linear  programming  can  merely  note  that  one 
proceeds  repeatedly  from  one  system  of  linear  equations  to  another  equivalent 
form  until  he  reaches  a system  from  which  the  desired  solution  appears  obvious. 

In  this  section  we  will  assume  that  the  game  matrix  A = [a^ ] has 
a . j > 0 for  all  i and  j . This  is  necessary  because  we  will  divide  through 
some  inequalities  by  values  which  we  assumed  to  be  positive.  One  can  prove 
that  if  he  adds  a number  a to  each  entry  in  the  matrix  [a^]  to  get  the 
matrix  [a^  + a],  then  these  games  both  have  the  same  optimal  strategies 
and  their  values  differ  by  a.  This  shows  that  one  can  add  a constant  to 
each  entry  in  a matrix  to  obtain  a new  matrix  A > 0,  and  thus  v and  V > 0; 
and  solving  this  new  game  yields  a solution  for  the  original  one  by  subtracting 
thi3  constant  from  its  value.  One  can  also  multiply  all  the  entries  in  a game 
by  a positive  constant,  for  example,  to  clear  it  of  fractions.  Since  one  can 
prove  that  the  games  [a..]  and  [ca..]  for  c > 0 have  the  same  optimal 


strategies  and  that  the  value  of  the  latter  is  c times  the  value  of  the 


former. 


In  section  2 we  saw  that  solving  a game  was  equivalent  to  solving  the 
dual  linear  programs  in  (3)  and  (4)  for  x,  y and  v (=V).  In  (3)  one  can 
divide  through  by  v and  define  the  m-dimensional  vector 


to  get 


1 

u = -x 


uA  > e 
— n 

T 1 
ue  = — 
m v 

u > 0. 


(min  — ) 

V 


Similarly,  one  can  let 


in  (4)  and  divide  by  V to  get 


w * y y 


T T 
Aw  < e 
— m 

T _ 1 

2nM  ' V 

w > 0. 


(max 


The  "primal"  problem  in  (8)  can  be  expressed  by  the  following  "simplex  table" 


I 
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(min  z) 


= -z 


where  all  w^  >_  0 and  where 


(9) 


■■-* 


The  w , ,w  . , . . . ,w  are  the  "slack"  variables.  In  matrix  form  this  table  is 
n+±  n+2  n+m 


A 

I 

m 

T 

e 

m 

-e 

n 

o 

m 

z 

where  I is  the  m by  m identity  matrix  and  o is  the  m-dimensional 
m m 

vector  of  all  zeros.  One  can  solve  the  primal  problem  given  in  this  table  for 
optimal  w and  z.  The  final  simplex  table  will  also  give  the  value  of  the 
optimal  u for  the  dual  problem  in  (6).  From  (5),  (7)  and  (9),  one  can  then 
compute  the  x,  y and  v which  will  solve  the  game  A.  This  method  will  now 
be  illustrated  by  some  examples. 

Example.  If  one  adds  2 to  the  matrix  for  Example  (v)  in  section  3 he 
obtains 


A = 


2 3 1 

12  3 


3 


1 


2 


which  has  the  table 


one  can  arbitrarily  pick  the  "pivot"  element  in  the  first  column.  The  numbers 
in  the  last  column  (but  not  the  last  row)  are  divided  by  the  respective  positive 
elements  in  this  first  column,  and  the  minimum  occurs  for  third  row.  Therefore, 
the  circled  number  3 in  the  third  row  is  the  pivot,  and  "pivoting"  on  it  gives 
the  second  equivalent  table 


0 

(7/3) 

-1/3 

1 

0 

-2/3 

1/3 

0 

5/3 

7/3 

0 

1 

-1/3 

2/3 

1 

1/3 

2/3 

0 

0 

1/3 

1/3 

0 

-2/3 

-1/3 

0 

0 

1/3  1 

1/3 

The  minimum  in  the  last  row  occurs  in  the  second  column,  and  the  minimum  of  the 
numbers  in  the  last  column  divided  by  the  positive  numbers  in  the  second  column 
occurs  in  first  row.  The  next  pivot  is  the  circled  number  7/3,  and  pivoting 
on  it  gives  the  third  table 


0 

1 

-1/7 

3/7 

0 

-2/7 

1/7 

0 

0 

-5/7 

1 

1/7 

3/7 

1 

0 

5/7 

-1/7 

0 

3/7 

2/7 

0 

0 

-3/7 

2/7 

0 

1/7 

3/7 

r 1 1 


I I 


i i 


I 


i 


1 1 


■i 
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The  minimum  in  the  last  row  occurs  in  the  third  column,  and  the  minimum  of  the 
numbers  in  the  last  column  divided  by  the  positive  numbers  in  the  third  column 
occurs  in  the  second  row.  The  next  pivot  is  the  circled  number  18/7,  and 
pivoting  on  it  gives  the  fourth  table 


w. 


0 

1 

0 

7/18 

1/18 

-5/18 

1/6 

0 

0 

1 

-5/18 

7/18 

1/18 

1/6 

1 

0 

0 

1/18 

-5/18 

7/18 

1/6 

0 

0 

0 

© 

1/6 

1/6 

1/2 

Since  the  last  row  is  nonnegative,  we  have  an  optimal  solution  which  is 

w = (1/6,  1/6,  1/6),  z = -1/2. 


The  optimal  solution  u for  the  dual  problem  can  be  read  off  the  last  row 
under  the  slack  variables,  that  is. 


u = (1/6,  1/6,  1/6). 

The  optimal  solution  for  the  game  A is 

x = (1/3,  1/3,  1/3)  = y,  v = 2. 

The  game 


A = 


7 5 6 

0 9 4 

14  1 8 


is  solved  by  the  simplex  method  in  the  following  tables.  From  the  third  table 
one  determines 


w = (0,  1/17,  2/17),  u = (0,  7/68,  5/68),  z = -3/17. 


The  optimal  solution  is 


y = (o. 

1/3,  2/3), 

x = 

(0,  7/12, 

5/12), 

v = 17/3. 

7 

5 

6 

1 

0 

0 

1 

0 

9 

4 

0 

1 

0 

1 

14 

1 

8 

0 

0 

1 

1 

-1 

-1 

-1 

0 

0 

0 

0 

-7/2 

17/4 

0 

1 

0 

-3/4 

1/4 

-7 

17/2 

0 

0 

1 

-1/2 

1/2 

7/4 

1/8 

1 

0 

0 

1/8 

1/8 

3/4 

-7/8 

0 

0 

0 

1/8 

1/8 

0 

0 

0 

1 

-1/2 

-1/2 

0 

-14/17 

1 

0 

0 

2/17 

-1/17 

1/17 

63/34 

0 

1 

0 

-1/68 

9/68 

2/17 

1/34 

0 

0 

0 

7/68 

5/68 

3/17 

5.  Applications.  The  finite  matrix  games,  along  with  their  generalizations 
to  the  cases  of  infinitely  many  pure  strategies  and  repeated  play  of  such  games, 
have  proved  useful  in  a great  number  of  applications.  These  include  allocation 
of  resources  (games  of  partitioning),  duel  theory  (games  of  timing),  search 
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problems,  as  well  as  statistical  decision  theory.  The  theory  of  two-person, 
zero-sum  games  in  normal  form  with  finitely  many  strategies  is  mathematically 
equivalent  to  the  theory  of  linear  programming  and  consequently  has  as  many 
uses.  Two  extremeJ.y  simple  examples  will  be  given  in  this  section  to  illustrate 
such  applications. 

(i)  A simple  search  game.  Assume  that  there  are  n points  on  a line 
labeled  (in  order)  l,2,...,n.  Player  I picks  one  point  at  which  to  hide. 
Player  II  picks  points,  one  at  a time,  at  which  to  look  for  I.  After  each 
choice  of  a point,  II  is  told  whether  he  has  found  I,  whether  he  has  chosen 
a point  too  high  (i.e.,  to  the  "right"  of  I),  or  whether  he  has  chosen  a 
point  too  low  (i.e.,  to  the  "left"  of  I).  The  payoff  to  player  I (from  II) 
is  the  number  of  choices  II  must  make  in  order  to  find  I. 

For  player  I there  are  n strategies:  l,2,...,n;  i.e.,  the  n places 

at  which  he  can  hide.  A strategy  for  player  II  is  a search  plan  or  hunting 
strategy.  This  can  be  represented  by  an  n-tuple  with  a "1"  in  the  position 
of  his  first  look,  with  a "2"  to  both  the  right  and  the  left  of  the  "1"  which 
tells  where  his  second  look  will  be,  with  a "3"  on  both  sides  of  each  "2" 

(so  that  the  "1"  falls  in  the  middle  of  the  four  "3's")  which  tells  where  his 
third  look  will  be,  etc.  For  example,  if  n = 7,  then  the  hunting  strategy 


(2, 3,1, 3, 4, 2, 3) 

says  that  II' s first  look  is  in  position  3,  that  if  he  is  too  high  then  his 
second  look  is  in  position  1 and  if  he  is  too  low  (on  his  first  look)  then  his 
second  look  is  in  position  6,  etc. 

This  game  has  been  solved  by  S.M.  Johnson  for  n 11  in  [24  (1964)]. 

The  solution  for  the  case  when  n = 3 follows.  When  n = 3,  player  I can 
pick  position  1,  2 or  3 in  which  to  hide.  Player  II  has  five  hunting  strategies: 


The  game  matrix  is 


Note  that  the  payoffs  in  each  column  give  the  same  triple  as  the  corresponding 
strategy  for  II.  This  game  is  solved  in  the  following  simplex  tables.  The 
optimal  strategy  for  I is  (.4, .2, .4)  and  for  II  it  is  (0,. 2, .6, .2,0). 
The  value  is  9/5. 


L 3/2 

5/2 

) 9/2 

11/2 

) -1 

-2 

) -1/2 

-1/2 
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(ii)  A duel.  Consider  a finite  duel  in  which  each  player  has  a gun 
which  contains  one  bullet.  Player  I has  a silent  gun,  i.e.,  II  does  not 
know  when  I has  fired;  and  player  II  has  a noisy  gun,  i.e.,  I knows  if 
II  has  fired.  At  the  start  the  players  are  10  steps  apart.  Assume  that  both 
players  have  the  same  accuracy  function:  after  a player's  k"tn  step  his  proba- 
bility of  hitting  his  opponent  is  k/5  where  k = 0,1, 2, 3, 4, 5.  Any  player  who 
hits  his  opponent  collects  one  unit  from  this  opponent,  and  the  duel  then 
terminates . 

If  player  I shoots  after  his  ith  step  and  player  II  shoots  after  his  j**1 
step,  then  the  payoffs  (in  expected  values)  from  II  to  I are: 

when  i < j 
when  i = j 
when  i > j . 

The  game  matrix  (multiplied  by  25)  is  given  below. 


5 


(i  - — )i 

5;5 


a. . 
i] 


= 0 


(1  - 1)  - 1 
VA  5J  5 


i 
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The  third  row  (i  = 2)  "dominates"  the  first  and  second  row,  and  the  fourth 
row  dominates  the  sixth  row.  These  dominated  rows  can  be  deleted  without  losing 
all  of  the  optimal  solutions  for  this  game.  Similarly,  the  first  two  columns 
can  be  deleted  because  they  dominate  the  third  column.  It  is  sufficient  to 
solve  the  game: 

5 

-5 
5 
15 


i 

Adding  5 to  each  entry  in  the  matrix  gives  the  matrix 


The  latter  game  B is  solved  in  the  simplex  tables  below. 


4 


5 

6 

3 

0 

10 

5 

12 

10 

10 

0 

5 

20 

5 

6 

3 l 

5 

5 

19/2  i 

1/2 

0 

1/4 

-42/5 

19/10 

1/4 


0 23/20 

0 

0 

1/5  -1/20 

3 

From  the  last  table  one  sees  that  the  game  B has  value  v = 60/11  and 

D 

optimal  strategies  (1/12,  1/10,  0)(60/ll)  = (5/11,  6/11,  0)  and 

(0,  1/6,  0,  l/60)(60/ll)  = (0,  10/11,  0,  1/11)  for  I and  II  respectively. 

It  follows  that  the  original  game  matrix  has  value  v = v^  - 5 = 5/11  and 
optimal  strategies  (0,  0,  5/11,  6/11,  0,  0)  and  (0,  0,  0,  10/11,  0,  1/11) 
for  I and  II  respectively.  Since  the  original  game  matrix  was  obtained  by 
multiplying  by  25,  one  gets  that  the  value  of  the  duel  is  1/55.  Player  I 
shoots  with  probabilities  5/11  and  6/11  after  steps  2 and  3.  Player  II 
shoots  with  probability  10/11  after  step  3,  and  with  probability  1/11  he 
walks  right  v"  to  I where  he  has  a sure  shot  (if  I has  not  already  killed  II) 
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In  many  duels  and  search  problems  the  players  have  an  infinite  number  of 
pure  strategies,  for  example,  all  the  points  on  an  interval,  or  all  the 
continuous  curves  in  the  plane.  Examples  of  such  duels  are  given  in  [5]  and 
C6]. 

6.  Two-person,  general-sum  games.  A two-person  general -sum  game  in 
normal  form  with  a finite  number  of  strategies  is  characterized  by  an  m 
by  n payoff  matrix  in  which  each  entry  is  a pair  of  numbers  corresponding 
to  the  payoffs  to  the  two  players.  Such  games  con  likewise  be  described  by 
a pair  of  real  valued  matrices  A and  B,  and  hence  are  referred  to  as  the 
bimatrix  games . The  rows  and  columns  respectively  correspond  to  the  pure 
strategies  for  the  players  I and  II.  One  can  also  consider  mixed  strategies 
for  each  player  which  are  probability  distributions  over  his  set  of  pure 
strategies . 

The  best  known  example  of  general-sum  games  is  the  two-person  prisoner’s 
dilemma,  due  originally  to  A.  W.  Tucker  in  1950  and  since  studied  in  great 
detail  by  Anatol  Rapoport  [19]  and  many  others.  Two  men,  I and  II,  are 
charged  with  a joint  crime,  and  held  separately  by  the  police.  Each  is  told 
that 

(a)  if  one  confesses  and  the  other  does  not,  then  the  former  will 
receive  a reward  of  one  unit  and  the  latter  will  be  fined  two 
units,  and 

(b)  if  both  confess,  each  will  be  fined  one  unit. 

The  prisoners  know  however  that 

(c)  if  neither  confesses,  both  will  go  free. 

The  resulting  payoff  matrix  follows. 
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XI 

Confess 

Not  Confess 

Confess 

(-1,-1) 

(1,-2) 

Not  confess 

(-2,1) 

(0,0) 

The  first  component  in  each  payoff  vector  is  for  player  I whereas  II 
obtains  the  second  component.  For  each  man,  the  strategy  "Confess"  dominates 
the  strategy  "Not  confess."  If  played  noncoopcratively , both  players  are 
likely  to  confess,  resulting  in  each  being  penalized  one  unit.  Technically, 
the  payoff  (-1,-1)  is  the  unique  "equilibrium"  point  in  this  game.  On  the 
other  hand , if  the  players  are  allowed  to  play  cooperatively , i . e . , to 
communicate  (perhaps  via  lawyers)  and  form  binding  agreements,  then  it  is 
likely  that  they  will  not  confess  and  both  will  go  free.  The  latter  outcome 
which  appears  on  the  northeast  edge  of  the  "payoff  space"  is  clearly  the 
best  solution  from  a global  perspective. 

Repeated  play  of  the  prisoner's  dilemma  games  provides  a miniature  model 
of  what  happens  in  arms  races,  price  wars,  run-away  advertising  campaigns, 
and  the  "tragedy  of  the  commons,"  in  which  each  individual  citizen  uses 
more  than  his  share  of  a renewable  resources,  thus  causing  its  ultimate 
depletion.  One  obtains  an  interesting  three-person  game  if  he  adds  the 
State  (or  world  community)  to  the  above  prisoner's  dilemma,  where  the  State's 
payoff  depends  upon  the  nature  of  the  fines  assessed. 

When  a game  is  general- sum  or  involves  more  than  two  players,  then  it 
is  essential  to  distinguish  between  whether  this  game  i3  played  cooperatively 
or  noncooperatively.  A cooperative  game  of  two  players  involves  elements  of 
both  cooperation  and  competition.  The  players  normally  agree  to  restrict  the 
outcomes  to  "Pareto  optimal"  ones,  i.e.,  payoff  vectors  on  the  "northeast" 


boundary  of  the  set  of  all  potential  payoffs.  They  then  must  bargain  over 
which  payoff  on  this  boundary  is  a distribution  of  wealth  acceptable  to  both 
parties.  This  latter  settlement  is  noncooperative  in  the  sense  that  increasing 
one  player's  payoff  decreases  the  other's  outcome.  Several  methods  for 
determining  an  equitable  payoff  vector  from  the  Pareto  optimal  ones  have 
been  proposed.  Chapter  6 in  the  book  by  Luce  and  Raiffa  [11]  is  still  an 
excellent  discussion  of  many  such  cooperative,  or  bargaining  solution,  concepts. 
When  there  are  more  than  two  players  in  a cooperative  game,  then  the  theory 
changes  drastically,  since  coalition  formation  then  becomes  a major  aspect 
of  the  problem.  Such  multiperson  cooperative  games  will  be  discussed  in 
Part  111. 


7.  n-person  noncooperative  games.  For  noncooperative  games  in  normal  form 
the  main  solution  concept  is  that  of  an  equilibrium  strategy.  Assume  that 
each  of  the  n player  (n  >_  2)  has  chosen  a particular  strategy  (pure  or 
mixed).  This  strategy  n- tuple  is  in  eoui librium  if  no  player  can  improve 
his  payoff  by  he  alone  switching  his  strategy  choice.  That  i3,  a unilateral 
deviation  by  just  one  player  cannot  improve  his  situation,  if  the  other  players 
continue  to  play  these  particular  strategies.  The  strategy  pair  (Confess, 
Confess)  is  an  equilibrium  outcome  in  the  prisoner's  dilemma  game.  The  optimal 
strategies  in  a two-person,  zero-sum  game  are  precisely  the  equilibrium  outcomes 
John  F.  Nash,  Jr.  [14,15]  proved  that  every  game  with  a finite  list  of 
pure  strategies  for  each  player  must  have  at  least  one  equilibrium  n-tuple  in 
mixed  strategies.  The  problem  of  actually  determining  such  equilibrium 
strategies  corresponds  to  optimizing  a multilinear  function  with  inequality 
constraints.  Precise  algorithms  exist  for  the  case  of  two  players,  and  recent 
algorithms  for  approximating  fixed  point  values  are  often  used  currently  for 
larger  values  of  n. 





Equilibrium  points  are  important  in  applications  of  game  theory  to  prob- 
lems in  fields  such  as  economics  and  operations  research  where  they  may  corre- 
spond to  prices  in  an  economic  market,  optimal  bidding  strategies,  or  the  best 
allocation  of  vehicles  over  a road  network. 

One  can  read  more  about  the  theory  of  equilibrium  points  for  noncooperative 
games  in  the  bcoks  by  Burger  [2]  and  by  Parthasarathy  and  Raghavan  [17]. 


29 


III.  The  Characteristic  Function  Form 

Introduction.  The  first  detailed  gams  theoretical  model  for  multi- 
person  cooperative  games  was  presented  in  1944  by  J.  von  Neumann  and 
0.  Morgenstem,  and  is  called  the  cooperative,  coalitional,  or  characteristic 
function  form  of  a game.  This  model,  which  comprises  the  greatest  part  of 
their  text  [25],  is  employed  in  the  study  of  situations  involving  three  or  more 
participants  acting  in  a cooperative  mode.  In  such  cooperative  behavior  the 
agents  are  allowed  to  get  together  in  coalitions  and  to  undertake  joint  action 
for  the  purpose  of  mutual  gain. 

The  estimated  worth  of  any  potential  coalition  is  a crucial  aspect  of 
such  models,  and  this  value  is  expressed  as  a numerical  measure  by  what  is 
called  the  characteristic  function.  The  term  von  Neumann-Morgenstern  solution 
or  simply  solution  in  this  context  refers  to  the  final  solution  concept  or  end 
product  for  their  coalition  formulation  of  cooperative  games.  A brief  intui- 
tive and  verbal  description  of  their  model  is  presented  first,  and  then  a mere 
precise  technical  definition  is  given. 

2.  An  overview  of  the  model.  There  are  four  essential  concepts  or 
fundamental  definitions  which  make  up  the  basic  cooperative  model.  First,  a 
multiperson  game  is  characterized  by  merely  assigning  a real  number  to  each 
possible  coalition  of  the  n participants,  where  each  number  represents  the 
value,  wealth  or  power  achievable  by  this  coalition  when  its  members  cooperate. 
Next,  one  describes  a set  of  n-dimensional  payoff  vectors  called  imputations . 
This  presolution  set  represents  all  reasonable  or  realizable  ways  of  distribu- 
ting the  available  wealth  among  the  n parties.  Then,  one  introduces  a 
preference  relation  between  certain  pairs  of  imputations.  One  imputation  is 
said  to  dominate  another,  if  there  is  some  coalition  in  which  each  of  its 
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members  prefers  the  former  payoff  to  the  latter  one,  and  if  this  coalition 
as  a whole  is  not  obtaining  more  in  the  former  imputation  than  it  can  effec- 
tively realize  in  the  game  through  its  own  efforts.  Finally,  a von  Neumann - 
Morgenstem  solution  is  any  subset  of  the  imputation  space  which  possesses  a 
certain  internal  and  external  consistency;  namely,  no  imputation  in  a solution 
dominates  another  one  in  this  solution,  and  any  imputation  not  in  the  solution 
is  dominated  by  another  one  within  the  solution.  So  a solution  when  taken  as 
a whole  i3  preferred  to  precisely  those  imputations  outside  of  this  set.  That 
is,  a solution  set  is  the  complement  of  its  "dominion." 
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3.  The  basic  model.  An  n-person  game  (in  characteristic  function  form) 
consists  of  a pair  (N,v)  where  N = (l,2,...,n)  is  a set  of  n players 
labeled  by  l,2,...,n,  and  where  v is  a characteristic  function  which 
assigns  a real  number  v(S)  to  each  nonempty  subset  (or  coalition)  S of  N. 
(Note  that  n again  represents  the  number  of  players  in  the  game,  rather 
than  the  number  of  strategies  for  player  II  as  was  the  case  in  Part  II.) 

One  normally  takes  the  integer  n >_  3,  and  assumes  that  v is  superadditive , 
i.e.  , v(S  UT)  ^ v(S)  + v(T)  for  disjoint  subsets  S and  T;  but  this 
latter  assumption  is  not  necessary  for  much  of  the  theory.  The  set  of 
imputations , denoted  by  A,  consists  of  all  vectors  x such  that 
x,  + x„  + ...  + x = v(N)  and  x.  > v({i})  for  all  i in  N,  where  each  x. 
is  a real  number  and  represents  a payoff  to  player  i.  These  two  relations 
are  referred  to  a3  Pareto  optimality  and  individual  rationality,  respectively. 
An  imputation  x dominates  an  imputation  y whenever  there  is  some  coalition 
S such  that  xi  > yL  for  all  i in  S and  xL  < v(S).  When  this 

latter  condition  is  satisfied  one  says  that  x is  effective  for  S.  A subset 
V of  A is  called  a von  Neumann -Morgenstern  solution  if  it  satisfies  two 


conditions:  no  imputation  x in  V dominates  any  imputation  in  V;  and 
every  imputation  y not  in  V is  dominated  by  at  least  one  imputation  in 
V.  These  conditions  are  called  internal  stability  and  external  stability. 


respectively,  and  now  one  frequently  refers  to  3uch  a solution  as  a stable  set. 

4.  An  example.  An  illustrative  example,  known  as  the  three-person 
"constant-sum"  game,  is  given  by  N = {1,2,3},  v({l,2,3})  = v({2,3>)  = 

v({l,3})  = v({l,2>)  = 1,  and  v({i})  =0  for  i = 1,  2 and  3.  Intuitively, 


any  coalition  of  two  or  three  players  has  the  power  to  distribute  the  total 
value  1 among  the  three  players,  e.g.,  a decision  by  majority  rule;  whereas 
an  individual  player  by  himself  is  assured  of  only  his  value  0.  The  impu- 
tation space  consists  of  the  triangular  set  or  simplex  A = {(x^x^Xg): 
x1  + x2  + «3  * 1 and  x^  0 for  i = 1,2,3}.  One  solution,  which  has  only 
three  imputations  as  well  as  the  "symmetry"  of  the  game,  is  the  set 
V = {(0,|,|),  (|,0,|),  (|,|,0)}.  Any  other  solution  for  this  game  consists 
of  all  those  imputations  which  give  a fixed  amount  = c^,  with  ® i < 
to  one  player  i,  and  distributes  nonnegative  amounts  x^  and  x^  to  the 
other  two  players  so  that  x^  + x^  = 1 - c^;  and  each  of  these  latter  sets 
is  referred  to  as  a discriminatory  solution. 

5.  Nature  of  the  theory.  To  develop  a mathematical  theory  for  a given 
game  model  like  the  one  above,  one  searches  for  answers  to  questions  such  as 
those  about  the  existence,  uniqueness,  nature,  mathematical  properties, 
structure,  and  various  representations  and  characterizations  for  the  ensuing 
solution  concepts.  From  the  applied  point  of  view  one  is  concerned  with  the 
computability  and  interpretation  of  solution  sets,  as  well  as  with  whether 
they  provide  any  new  insights  into  theory,  or  in  practice  when  applied  to 
situations  in  the  real  world. 


It  was  finally  demonstrated  by  W.  F.  Lucas  [8,9]  that  not  every  game  need 
have  a solution.  However,  all  such  kncvni  examples  have  two  or  more  players, 
and  it  appears  that  the  nonexistence  of  solutions  is  rare.  On  the  other  hand, 
some  solution  sets  have  been  characterized  for  several  special  but  large  classes 
of  games.  A good  sample  of  the  research  in  thi3  direction  is  contained  in 
several  papers  in  four  of  the  five  volumes  devoted  to  game  theory  in  the 
Annals  of  Mathematics  Studies  edited  by  A.  W.  Tucker  and  others  [24].  It 
turns  out  that  many  games  have  a great  abundance  of  different  solution  sets. 

This  lack  of  uniqueness,  plus  the  great  multiplicity  of  imputation  in  most 
individual  solutions,  leaves  a great  arbitrariness  or  ambiguity  in  determining 
any  ultimate  payoff  vector  for  many  games.  Furthermore,  some  solutions  are 
known  to  have  a very  complex  or  elaborate  structure  as  is  known  from  work  of 
L.  S.  Shapley,  and  it  is  unlikely  that  one  will  be  able  to  give  a plausible 
intuitive  or  behavioralistic  interpretation  to  all  such  irregular  sets , or 
to  design  algorithmic  methods  for  constructing  them.  It  appears  in  general 
that  solution  theory  is  a deep  and  difficult  mathematical  subject  and  that 
many  rich  and  fascinating  structures  are  possible.  A very  readable  introduction 
to  solution  theory  as  well  as  the  most  complete  bibliography  on  the  subject 
will  appear  in  Chapter  6 of  a forthcoming  book  by  L.  S.  Shapley  and  M.  Shubik; 
and  a preliminary  version  by  the  authors  [21]  has  appeared  in  report  form.  A 
more  technical  survey  of  some  important  recent  results  on  this  subject  was 
written  by  Lucas  [10]. 

Several  generalizations,  variations  and  extensions  of  the  classical 
von  Neumann- Morgenstern  theory  of  solutions  have  also  been  investigated. 

These  include  in  part:  the  games  without  side  payments  surveyed  by  R.  J. 

Aumann  in  [22]  and  included  in  Shapley  and  Shubik  [21],  the  games  in  partition 
function  form  presented  by  R.  M.  Thrall  and  Lucas  [23],  more  dynamical  approaches 
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to  solution  concepts  as  discussed  in  the  work  of  R.  J.  Weber  [27 ],  the  game 
models  which  make  use  of  an  infinite  number  of  players,  and  models  built  upon 
other  abstract  mathematical  structures.  In  addition,  several  different  types 
of  models  and  alternate  solution  concepts  along  the  lines  of  the  classical 
formulation  for  games  in  coalition  form  have  since  been  introduced.  The  core, 
value  theories,  the  bargaining  sets  and  the  nucleolus  for  cooperative  games 
are  discussed  in  the  next  section. 

6.  Other  solution  concepts.  Several  other  solution  concepts  have  been 
developed  since  the  original  von  Neuma~n-Morgenstern  solutions  (or  stable  sets). 
Four  of  these  alternate  solution  ideas,  which  are  well  known  and  have  use  in 
applications,  will  be  introduced  in  this  section.  These  models  make  use  of  the 
same  definition  for  a game  (N,v)  and  for  the  set  of  imputations  A as  those 
given  above. 

(i)  The  core.  The  concept  of  the  core  of  a game  was  defined  explicitly 
by  D.  B.  Gillies  in  [24]  and  L.  S.  Shapley  in  1953.  The  core  of  the  game 
(H,v)  is  the  set 

C = (x  ( A:  £if.s  *£  > v(S)  for  all  S c N}. 

No  coalition  can  overturn  an  agreed  upon  imputation  in  the  core,  since  no 
element  in  A can  dominate  an  imputation  in  C.  For  superadditive  games, 
the  core  is  precisely  those  imputations  which  are  maximal  with  respect  to  the 
relation  of  dominance. 

Consider  the  three-person  game  with  v({l,2,3})  = v({l,2})  = v({l,3})  = 0 
and  v({ 2 ,3} ) = v({l>)  = v({2})  = v({3>)  = 0.  For  this  example,  C consists 
of  the  one  imputation  (1,0,0)  which  gives  the  full  amount  to  player  1.  In 
this  "veto-power"  game  , C treats  1 as  though  he  were  a "dictator". 
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A main  problem  with  the  core  is  that  for  many  games  it  turns  out  to  be 
the  empty  set.  This  is  true,  for  example,  in  the  three-person,  constant-sum 
game  in  section  4.  In  applications  of  game  theory  to  political  science,  many 
games  have  an  empty  core.  Whereas,  many  examples  of  games  which  arise  in 
economics  do  have  a nonempty  core,  and  the  core  then  proves  to  be  an  important 
analytical  tool.  However,  the  example  in  this  section  illustrates  that  a 
nonempty  core  may  sometimes  prove  to  be  "too  small,"  and  not  to  contain  the 
outcomes  which  would  likely  arise  from  actually  playing  the  game. 

(ii)  The  Shapley  value.  In  1953  Shapley  [24]  introduced  a solution 
concept  which  determines  a unique  imputation  <t>  for  each  game  (N,v).  This 
outcome  is  now  called  the  Shapley  value  and  is  given  by  the  formula 


+ . = l Qv(S)  - v(S  - U})] 

i n . 


for  each  i ( N,  where  s is  the  number  of  players  in  coalition  S and  the 
summation  is  taken  over  all  subsets  S of  N which  contain  the  player  i. 

The  value  ♦ i3  the  unique  imputation  which  satisfies  four  axioms  stated  by 
Shapley  which  are  called  efficiency,  the  dummy  axiom  (i.e.,  powerless  players 
receive  nothing),  symmetry,  and  additivity.  These  axioms  are  properties  which 
would  be  desirable  of  any  equitable  allocation  scheme.  The  Shapley  value  can 
thus  be  viewed  as  a fair-division  solution  concept.  It  has  been  used  in 
economic  problems  to  set  fair  rates  for  services,  and  in  political  science 
to  assign  power  equitably.  It  also  has  a probabilistic  interpretation  as  the 
average  incremental  gain  caused  by  player  i joining  coalition  S - i to 
obtain  S.  Furthermore,  ♦ also  arises  from  certain  fair  bargaining  schemes, 
i.e.,  where  players  3plit  equitably  any  gains  from  all  potential  ways  of  building 
up  from  n separate  players  to  the  grand  coalition  N. 
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(iii)  The  nuclaolus.  Another-  solution  concept  which  always  gives  a 
unique  imputation  for  any  game  (N,v)  is  the  nucleolus  which  was  introduced 

by  D.  Schmeidler  [20 3 . First,  define  the  excess  of  any  nonempty  subset  S 

of  N with  respect  to  the  imputation  x € A as  e(x,S)  = v(S)  - 
One  can  set  e(x,0)  = 0 for  the  empty  set  0,  and  note  that  e(x,N)  = 0. 

The  excess  represents  the  "group  attitude"  of  the  coalition  S towards  its 
payoff  at  imputation  x.  in  the  core  where  each  coalition  S is  satisfied, 
e(x,S)  0.  If  S gets  less  than  its  value  v(S)  at  some  imputation  x, 
then  the  corresponding  excess  is  negative  and  S has  incentive  to  form  and 
ask  for  more.  The  nucleolus  is  the  imputation  which  minimizes  the  largest 
excess,  i.e.,  it  simultaneously  minimizes  the  largest  coalitional  "complaint." 

In  the  event  that  this  maximum  excesses  attains  a minim'im  at  various  imputations, 
then  one  compares  the  next  largest  excesses,  and  so  on,  in  order  to  arrive  at 

the  unique  nucleolus.  In  other  word3,  for  each  x one  arranges  the  excesses 

e(x,S)  in  nonincreasing  order.  The  nucleolus  is  then  the  one  particular  x 
which  gives  a minimum  in  the  "lexicographical"  ordering  of  these  arrangements. 

The  nucleolus  always  exists  and  is  unique  for  each  game.  It  is  an 
element  in  the  core  when  the  latter  is  nonempty,  and  it  is  also  a member  of 
many,  but  not  all,  of  the  bargaining  set3  mentioned  below.  It  can  be  computed 
by  solving  a sequence  of  linear  programming  problems  or  equivalently  one  very 
large  program,  but  such  computations  are  lengthy  unless  n is  small.  In 
applications,  the  nucleolus  can  also  be  used  to  set  rates  for  services  and 
appears  to  be  a good  approach  for  setting  tax  rates.  It  has  been  proposed  as 
a scheme  for  setting  fines  or  other  chargas  for  firms  that  pollute  the 
environment . 

(iv)  Bargaining  sets.  In  1964  R.  J.  Aumann  and  M.  Maschler  published 
in  [24]  some  dozen  different  solution  concepts  referred  to  as  bargaining  sets. 
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Their  models  imitate  rather  closely  what  actually  takes  place  in  real  bargaining 
situations,  and  are  similar  to  what  hapens  in  game  theoretical  experiments. 

They  also  consider  more  explicitly  how  the  set  N of  players  fragments  into 
coalition  structures , i.e.,  into  partitions  P = {P^,P0,. . • of  H,  where 
the  P^  are  disjoint  coalitions  whose  union  is  N.  They  also  enlarge  the 
set  of  imputations  to  include  more  vectors  than  given  by  A.  Every  such 
extended  imputation  x along  with  a corresponding  coalition  structure  P will 
be  called  a payoff . A payoff  (x,P)  is  stable,  or  is  an  element  of  a 
bargaining  set,  if  it  can  be  "defended"  against  various  other  payoffs  which 
will  be  proposed  instead. 

The  crucial  concepts  in  their  models  are  the  relations  of  objection  and 
counterobj action.  These  technical  definitions  are  rather  lengthy,  and  thus 
only  intuitive  statements  about  them  are  presented  here.  An  objection  by  a 
coalition  K to  a disjoint  coalition  L at  a payoff  (x,P)  is  a second 
payoff  (y,Q)  in  which  each  player  in  K obtains  more  and  in  which  each 
player  they  must  use  to  achieve  thi3  new  payoff  does  at  least  as  well.  A 
counterobjection  by  L to  K in  this  objection  is  a third  payoff  (z,R) 
in  which  the  players  in  L obtain  at  least  their  original  amounts  in  x and 
in  which  any  "partners"  in  R whose  cooperation  L needs  are  not  v/orse  off 
than  they  were  in  x or  y.  A payoff  is  stable  if  for  each  objection  to  it 
there  exists  a corresponding  counterobjection.  A bargaining  set  is  the  set 
of  those  payoffs  which  are  stable.  Since  there  are  different  ways  to  define 
payoff,  objection  and  counterobjection,  there  are  several  different  solution 
concepts  which  are  called  bargaining  sets. 

So  a payoff  is  not  unstable  merely  because  seme  group  can  object  to  it. 
Many  such  objections  really  carry  little  weight,  since  they  can  easily  be 
countered.  A payoff  is  unstable,  however,  if  there  is  any  objection  to  it 
which  cannot  be  countered. 


7.  An  application  to  po.15.tics,  A game  (N ,v)  in  characteristic  function 
form  is  called  a simple  game  if  v(S)  = 0 or  1 for  each  coalition  S contained 
in  the  player  set  N.  A simple  game  is  said  to  be  monotone  if  ScT  implies 
v(S ) <^v(T).  Monotone  simple  games  can  be  used  to  model  many  voting  situations 
a losing  coalition  S has  value  v(S)  = 0 and  a winning  coalition  S is 
assigned  value  v(S)  =1.  A particular  class  of  such  voting  games  is  the 
weighted  voting  games  in  which  each  player  i in  N casts  a ballot  with 
weight  w^  and  in  which  a coalition  S wins  whenever  its  total  weight 

w^  equals  or  exceeds  some  given  number  q called  the  quota . 

The  value  type  of  solution  concepts,  such  as  the  Shapley  value,  can  be 
used  as  indices  to  measure  the  voting  powers  of  the  various  players.  One 
such  value  concept,  proposed  by  the  lawyer  John  F.  Banzhaf,  III  [1],  has 
actually  been  accepted  in  several  court  rulings  in  the  United  States  as  a 
reasonable  measure  of  pove:->  for  determining  equity  in  certain  weighted  voting 
systems . 

As  an  illustration,  consider  a corporation  with  five  stockholders  denoted 
by  1,  2,  3,  4 and  5 who  own  40,  25,  20,  10  and  5 percent  of  the  stock  respec- 
tively. Assume  that  a simple  majority  is  necessary  to  pass  any  legislation. 

The  minimal  sized  winning  coalitions  are  {1,2},  {1,3}  and  {2,3,4}.  The 

Shapley  value  for  this  game  is  the  vector  $ = (5,3,3,1,0/12,  and  it  can 
be  defended  as  a reasonable  measure  of  the  respective  voting  powers  for  the 
players.  Note  that  player  5 i3  powerless*,  if  he  a2 one  switches  his  vote 
he  will  never  change  the  outcome  on  any  ballot. 

8.  An  application  to  economics.  In  a pure  exchange  economy  each  trader 
brings  a bundle  of  commodities  to  a market,  and  these  participants  proceed 

to  redistribute  their  goods.  Presumably  the  goal  of  each  such  economic  agent 
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is  to  depart  with  a commodity  bundle  which  he  prefers  over  his  initial  one. 
Assume  furthermore  that  each  such  trader  has  a utility  function  which  expresses 
his  preferences  over  the  possible  bundles  which  he  can  secure,  and  assume 
that  each  one  attempts  to  maximize  his  resulting  utility.  This  situation 
can  be  treated  as  a multiperson  cooperative  game  in  which  the  characteristic 
function  value  v(S)  of  each  coalition  S is  the  maximum  total  utility  to 
the  players  in  S if  they  achieve  an  optimal  trade  with  those  goods  available 
within  their  coalition.  To  simplify  cur  model,  assume  that  the  value  to 
coalition  S is  the  sum  of  the  individual  utilities  of  the  players  in  S for 
the  bundles  they  each  receive. 

As  a simple  illustration,  consider  a friendly  coffee  break  with  three 
participants  denoted  by  1,  2 and  3.  Each  participant  brings  certain  ingredients 
and  each  has  a different  preference  for  wliat  he  wishes  to  drink.  Let  the 
commodities  be  coffee,  tea,  cream  anl  sugar.  Player  1 has  two  units  of  coffee, 
and  prefers  co  drink  tea  with  sugar.  Player  2 has  one  unit  of  tea  and  wishes 
to  drink  coffee  with  cream.  Player  3 has  two  units  of  cream  and  three  units 
of  sugar  and  desires  to  drink  coffee  with  cream  and  sugar.  One  can  describe 


a typical  commodity  vector  as  y = (y^  ^ ’^3  ’^4^  » said  denote  the  initial 

1 2 

bundles  for  the  three  players  by  w = (2, 0,0,0),  w'  = (0,1, 0,0)  and 
w‘*  = (0,0, 2, 3).  And  their  respective  utility  functions  will  be  assumed  to  be 
u (y)  = ir.ax{y2,y4},  u (y)  = maxty^yg),  and  u (y)  = max{y1,y3,y4).  Then 
the  total  utility  available  to  a coalition  S c {1,2,3}  is  max  u1(y1) 

where  y1  is  player  i's  bundle  and  where  this  maximum  is  subject  to  the 
constraint,  or  conservation  law,  ^ = ^ifS  W ' Un<^er  "th®36  assumptions, 

the  characteristic  function  for  this  game  is  v({l})  = v({2})  = v({3})  = 
v({l,2})  = v({2,3>)  = 0,  v({l,3})  = 2,  and  v({l,2,3>)  = 3.  The  set  of 
imputations  is  A = {(x^Xg.Xg):  xJ[  + x2  + x3  = 3;  x^  x2  and  x3  ^0}, 


I I — M — -v-- 
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IV.  Games  in  Extensive  Fora 


1.  Graph  theory.  A few  very  simple  ideas  from  graph  theory  will  be 
mentioned  briefly,  since  a game  in  extensive  (or  tree)  form  is  usually  defined 
in  terms  of  such  concepts.  A graph  consists  of  a set  of  points,  called  vertices 
or  nodes,  along  with  a set  of  (unordered)  pairs  of  distinct  vertices,  called 
edges  or  arcs.  The  edges  can  be  viewed  as  lines  connecting  the  corresponding 
pairs  of  vertices.  The  degree  of  a vertex  is  the  number  of  distinct  edges 
in  which  it  appears,  i.e.,  the  number  of  lines  emanating  from  this  vertex. 

A graph  has  a cycle  if  one  can  "pass"  through  a sequence  of  vertices  and  return 
to  the  original  one  by  moans  of  di3t5.nct  edges.  Such  a closed  path  will  not 
retrace  any  of  its  edges.  A graph  is  connected  if  one  can  pass  from  any  vertex 
to  any  other  one  by  means  of  a sequence  of  adjacent  edges. 


2 . Definitions . A general  n-person  game  in  extensive  form  is  a topological 
tree  (i.c.,  a finite  connected  graph  with  no  cycles  and  with  no  vertices  of 
degree  two)  with  the  following  specifications.  There  is  one  distinguished 
vertex  corresponding  to  the  starting  point,  and  referred  to  as  the  root . 

Each  nonterminal  vertex  is  a choice  point  and  is  labeled  with  one  of  the  n 
players  l,2,...,n*,  or  by  the  "chance  player"  denoted  by  0.  Each  edge  "leading 
out"  of  a vertex  describes  a possible  move  by  the  corresponding  player  if  this 
point  in  the  game  is  reached.  Each  vertex  labeled  by  0 has  a probability 
distribution  over  its  moves.  To  each  terminal  vertex  there  is  assigned  ao 
n-dimensional  payoff  vector  whose  components  describe  the  outcomes  to  the 
respective  players  when  the  game  end 3 there.  The  set  of  all  vertices  for  a 
particular  player  i is  partitioned  into  information  sets.  When  it  is  one  of 
his  turns  to  make  a choice,  i is  aware  of  the  information  set  he  is  in,  but 
he  does  not  know  the  precipe  vertex  within  this  set.  For  each  vertex  in  a 
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given  information  set  there  must  be  the  same  number  of  potential  moves,  and 
one  normally  assumes  that  in  playing  a game  no  such  vertex  can  come  "after" 
another  one  in  the  same  information  set. 

When  engaged  in  a particular  game  each  player  is  faced  with  the  problem 
of  how  to  best  play  the  game  in  order  to  maximize  his  expected  payoff.  A 
player ' s complete  plan  for  playing  a game  is  called  a strategy.  There  are 
several  different  ways  in  which  one  can  specify  such  a coherent  plan  of  action. 

A pure  strategy  for  player  i is  a rule  for  picking  a particular  move  at 
each  of  his  information  sets.  It  is  a function  which  assigns  to  each  information 
set  a particular  one  of  his  available  choices.  A mixed  strategy  for  i is 
a global  randomization  over  his  pures,  that  is,  a probability  distribution 
over  the  set  of  all  pure  strategies.  A behavioral  strategy  for  i is  an 
overall  plan  for  local  randomization;  that  is,  a behavioral  strategy  consists 
of  a class  of  probability  distributions  such  that  one  particular  distribution 
is  assigned  to  the  set  of  moves  at  each  one  of  his  information  sets.  Certain 
combinations  of  "partial"  pure  strategies  called  "signaling  strategies"  and 
"associated"  behavioral  strategies  are  called  composite  strategies. 

The  main  solution  concept  for  games  in  extensive  form  is  the  same  Nash 
equilibrium  pofnt  which  was  introduced  in  Part  II,  i.e.,  a collection  of  n 
optimal  strategies  (one  for  each  player)  such  that  a unilateral  change  in 
strategy  by  only  one  player  cannot  possibly  improve  his  expected  payoff. 

The  principal  computational  problem  is  to  determine  such  equilibrium  points  for 
a given  game. 

3.  Information  and  existence  theorems.  Most  of  the  major  results  about 
extensive  games  are  of  a theoretical  nature.  These  theorems  guarantee  the 
existence  of  optimal  strategies  which  will  achieve  an  equilibrium.  In  1912 


E.  Zermelo  [29 ] demonstrated  the  existence  of  an  optimal  pure  strategy  for 
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two-person  zero-sum  games  with  perfect  information,  that  is,  games  such  as 
checkers  or  chess,  in  which  all  information  sets  contain  a single  vertex. 

A player  has  perfect  information  implies  that  he  can  always  reconstruct  the 
entire  past  history  of  the  game  along  the  unique  path  from  the  initial  vertex 
(root)  up  to  his  current  choice  vertex.  H.  W.  Kuhn  [7,  24  (1953)]  extended 
these  results  about  optimal  pure  strategies  to  the  n-person  general-sum  games 
with  perfect  information.  In  1928  John  von  Neumann  showed  the  existence  of 
optimal  mixed  strategies  for  any  two-person  zero-sum  game;  this  is  the  Minimax 
Theorem  or  Fundamental  Theorem  of  Game  Theory  mentioned  before.  Nash  [14,15] 
extended  the  equilibrium  concept  beyond  the  two-person  zero-sum  games,  and 
he  proved  that  there  are  optimal  mixed  sti'ategies  in  the  n-person  general-sum 
case.  Kuhn  also  showed  the  existence  of  optimal  behavioral  strategies  for 
games  with  "perfect  recall"  such  as  in  poker.  A game  has  perfect  recall  if 
each  player  is  "aware"  at  each  of  his  moves  of  precisely  what  moves  he  chose 
prior  to  it,  but  may  not  know  all  the  prior  choices  made  by  the  other 
players.  G.  L.  Thompson  [24  (1953)]  proved  that  composite  strategies  suffice 
to  obtain  an  equilibrium  point  for  an  arbitrary  game ; and  he  illustrated  his 
theory  for  simplified  models  of  bridge  in  which  partners  ure  treated  as  single 
players  who  alternately  "forget"  certain  information. 

4.  Examples . The  following  examples  will  illustrate  some  of  the  defini- 
tions and  theorems  presented  above. 

(i)  Consider  the  following  three-person  game  with  perfect  information 


in  which  the  players  are  denoted  by  I,  II  and  III. 
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Player  I begins  by  choosing  either  the  upper  branch  labeled  1 or  the  lower 
branch  labeled  2.  In  the  former  case,  II  then  picks  a,  b or  c.  Choice 
a or  b will  end  the  game  with  the  payoff  vectors  (0,1,0)  and  (1,0,3) 
respectively.  Whereas  choice  c leaves  the  final  move  up  to  player  I who 
then  picks  3 or  4 to  terminate  at  outcomes  (4, 2.-1)  or  (0,0,2).  If  I 
had  initially  chosen  the  lower  branch  2,  then  player  III  chooses  between 
moves  A and  B.  Move  B ends  the  game,  whereas  choice  A leaves  the  final 
move  to  player  II  who  picks  cither  d or  e.  The  equilibrium  payoff 
(4, 2,-1)  is  obtained  when  plaver  I,  II  and  III  play  their  pure  strategies 
(1,3),  (c,e>  and  A,  respectively. 

The  proof  that  a (finite)  game  with  perfect  information  has  a pure 
strategy  optimal  solution  follows  from  a simple  backwards  induction,  i.e.. 


the  game  tree  can  be  repeatedly  "pruned"  back  from  the  terminal  vertices  to 
the  root.  In  our  example,  the  branch 


since  a rational  player  I will  surely  use  alternative  3 instead  of  4.  One 
can  work  back  in  this  way  from  the  terminal  nodes  to  the  initial  one. 

(ii)  The  well  known  two-person  game  of  matching  pennies  can  be  described 


not  have  perfect  recall.  The  payoffs  are  not  listed  in  these  examples. 


In  the  first  example  I forgets  what  action  he  took  at  an  earlier  stage,  and 
in  the  second  example  II  forgets  what  he  knew  at  the  previous  move. 

(iv)  The  following  example,  given  by  H.  W.  Kuhn,  indicates  how  behavioral 
strategies  need  not  suffice  to  achieve  the  best  solution  in  a game  without 
perfect  recall. 


Chance,  denoted  by  0,  deals  a high  card  H to  one  player  and  a low  card  L 
to  the  other,  with  each  deal  being  equally  probable.  The  holder  of  the  high 
card  then  receives  1 unit  from  the  other  player,  and  also  has  the  choice  of 
whether  to  stop  the  game  s or  to  continue  it  c.  In  the  latter  case  player  I 
has  the  option  of  leaving  the  cards  the  way  they  are,  l,  or  of  trading  cards 


with  his  opponent,  t.  However,  at  this  stage  of  the  ga:. e I has  forgotten 
who  originally  held  the  high  card. 

The  optimal  mixed  strategy  for  player  I is  to  mix  »is  pure  strategies 
(s,t)  and  (c,A)  with  equal  probability;  and  II  shoulc  play  both  s and 
c with  probability  ^ . An  expected  payoff  to  player  I of  ^ will  result. 

One  can  show  however  that  if  player  I were  restricted  to  a behavioral  strategy , 
i.e.,  one  probability  distribution  over  c and  s and  another  over  l and  t, 
then  the  best  expected  value  which  he  can  assure  himself  is  0. 

It  is  true  that  each  mixed  strategy  induces  a behavioral  strategy  in  a 
natural  way,  and  each  behavioral  strategy  induces  a particular  mixed  strategy 
which  in  turn  reinduces  that  same  behavioral  strategy.  However,  if  a game 
lacks  perfect  recall,  then  not  all  mixed  strategies  can  be  induced  from  behavioral 
strategies . 

5.  Applications . When  a game  arises  in  applicc.tions , one  frequently  begins 
his  analysis  by  describing  the  game  in  extensive  form.  This  gives  a rather 
complete  picture  of  the  problem,  including  the  detailed  structure  or  rules  of 
the  game,  the  sequence  of  all  possible  moves,  the  state  of  each  player's 
information,  and  the  payoffs.  Except  for  very  elementary  games,  however,  one 
does  not  normally  pursue  his  investigation  in  the  extensive  form.  This  is 
because  the  mathematical  problem  of  actually  determining  optimal  strategies  for 
this  form  in  an  efficient  manner  has  not  been  resolved. 

Instead,  one  reduces  the  game  to  its  normal  form  by  considering  the  full 
li3t  of  pure  strategies  for  each  player  and  the  resulting  payoffs  when  these 
strategies  are  employed.  In  theory  it  is  a much  simpler  problem  to  compute 
optimal  strategies  in  the  normal  form.  As  mentioned,  in  the  case  of  the  two- 
person  zero-sum  games,  it  is  equivalent  to  solving  a pair  of  dual  linear  programs 
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Good  algorithms  also  exist  in  the  case  of  two-person,  general-sum  games.  For 
larger  numbers  of  players,  it  is  usually  difficult  to  determine  optimal  solu- 
tions, and  this  is  still  an  active  area  of  research  for  games  in  normal  form. 
Furthermore,  in  practice  one  usually  gets  an  enormous  increase  in  the  number 
of  parameters  necessary  to  describe  a mixed  strategy  in  the  resulting  normal 
form  compared  to  the  number  of  variables  necessary  to  determine  a behavioral 
strategy  in  the  original  game  tree.  For  example,  H.  W.  Kuhn  has  described 
a trivial  poker  game  in  which  the  simplex  of  mixed  strategies  has  dimension 
8191  while  the  "cube"  of  behavioral  strategies  has  dimension  13.  This 
astronomical  increase  in  the  number  of  variables  to  be  determined  actually 
occurs  in  some  important  real-world  problems  and  often  forces  the  analyst 
to  abandon  the  game  theoretic  approach. 

In  audition,  even  if  the  reduction  to  normal  form  results  in  a problem 
which  is  computationally  feasible,  there  is  still  a major  concern  about 
whether  this  approach  is  philosophically  sound.  It  is  true  that  for  games 
with  perfect  recall  an  optimal  mixed  strategy  induces  a behavioral  strategy 
which  will  achieve  the  same  expected  payoff.  It  is  questionable,  at  least 
in  some  people's  minds,  whether  one  would  or  should  always  play  throughout 
the  game  according  to  this  latter  strategy. 

Some  of  the  many  applications  of  the  games  in  extensive  form  have  been 
to  areas  of  pure  mathematics,  including  topics  in  logic  as  well  as  in  the 
very  foundations  of  mathematics.  Certain  problems  in  the  area  of  combina- 
torial games  relate  to  questions  on  computational  complexity.  Some  of  the 
developments  in  this  direction  are  indicated  in  the  recent  book  by  J.  H. 
Conway  [3].  It  has  been  shown  that  certain  game  trees  of  infinite  length 
and  perfect  information  need  not  have  a pure  strategy  optimal  solution  if  one 
assumes  the  axiom  of  choice.  This  has  given  rise  in  turn  to  alternate 
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assumptions  and  to  questions  about  the  relationship  between  such  fundamental 
assumptions,  which  are  most  basic  to  much  modern  mathematics.  A paper  by 

| 

Mycielski  [13]  gives  an  indication  of  some  results  and  problems  in  this  latter 

direction. 
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